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THE FIRST GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 


METHOD OF THE PRESENT INVENTION 


Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the spatial phase of the 
transmitted PLIB along the planar extent thereof according to 
a spatial phase modulation function (SPMF) so as to produce 
numerous substantially different time-varying speckle-noise 
patterns at the image detection array of the IFD Subsystem 
during the photo-integration time period thereof. 


Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 


FIG. 1I2B 
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THE SECOND GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 


METHOD OF THE PRESENT INVENTION 


Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the temporal intensity of 
the transmitted PLIB along the planar extent thereof 
according to a temporal intensity modulation function (TIMF) 
so as to produce numerous substantially different time- 
varying speckle-noise patterns at the image detection array 
of the IFD Subsystem during the photo-integration time 
period thereof. 


Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE THIRD GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 


METHOD OF THE PRESENT INVENTION 


Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the temporal phase of the 
transmitted PLIB according to a temporal phase modulation 
function (TPMF) so as to produce numerous substantially 
different time-varying speckle-noise patterns at the image 
detection array of the IFD Subsystem during the photo- 
integration time period thereof. 


Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE FOURTH GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 


METHOD OF THE PRESENT INVENTION 


Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the temporal frequency of 
the transmitted PLIB along the planar extent thereof 
according to a temporal intensity modulation function (TIMF) 
so as to produce numerous substantially different time- 
varying speckle-noise patterns at the image detection array 
of the IFD Subsystem during the photo-integration time 
period thereof. 


Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 


integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE FIFTH GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 


METHOD OF THE PRESENT INVENTION 


Prior to illumination of the target with the planar laser 
illumination beam (PLIB), modulate the spatial intensity of the 
transmitted PLIB along the planar extent thereof according to 
a spatial intensity modulation function (SIMF) so as to 
produce numerous substantially different time-varying 
speckle-noise patterns at the image detection array of the 
IFD Subsystem during the photo-integration time period 
thereof. 


Temporally average the numerous substantially different 
time-varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
power of the speckle-noise pattern observed at the image 
detection array. 
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THE SIXTH GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 


METHOD OF THE PRESENT INVENTION 


After illumination of the target with the planar laser 
illumination beam (PLIB), modulate the spatial intensity of the 
reflected/scattered (i.e. received) PLIB along the planar 
extent thereof according to a spatial intensity modulation 
function (SIMF) so as to produce numerous substantially 
different time-varying speckle-noise patterns at the image 
detection array of the IFD Subsystem during the photo- 
integration time period thereof. 


Temporally average the many substantially different time- 
varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
speckle-noise pattern observed at the image detection array. 


FIG. 1I22B 
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THE SEVENTH GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 
METHOD OF THE PRESENT INVENTION 


After illumination of the target with the planar laser 
illumination beam (PLIB), modulate the temporal intensity of 
the reflected/scattered (i.e. received) PLIB along the planar 
extent thereof according to a temporal intensity modulation 
function (TIMF) so as to produce many substantially different 
time-varying speckle-noise patterns at the image detection 
array of the IFD Subsystem during the photo-integration time 
period thereof. 


Temporally average the many substantially different time- 
varying speckle-noise patterns produced at the image 
detection array in the IFD Subsystem during the photo- 
integration time period thereof, so as to thereby reduce the 
speckle-noise pattern observed at the image detection array. 
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THE EIGHT GENERALIZED SPECKLE-NOISE PATTERN REDUCTION 
METHOD OF THE PRESENT INVENTION 


Use a PLIIM-BASED Imager to produce a series of consecutively 
captured digital images of an object over a series of photo-integration 
time periods of the PLIIM-Based Imager, wherein each digital image of 

the object includes a substantially different speckle noise pattern 
produced by natural oscillatory micro-motion and/or forced oscillatory 
micro-movementof the Imager relative to the object during operation of 
the PLIIM-Based Imager. 


Store the series of consecutively captured digital images of the object in 
buffer memory within the PLIIM-Based Imager. 


jr. 


Add relatively small (e.g. 3x3) windowed image processing filters to the 

additively combine and average the pixel data in the series of 
consecutively captured digital images so as to produce a reconstructed 
digital image having a speckle noise pattern with reduced RMS power. 


FIG. 1I24D 
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THE NINTH GENERALIZED METHOD OF REDUCING SPECKLE PATTERN 


NOISE IN PLIIM-BASED IMAGING SYSTEMS 


During each photo-integration time period of a PLIIM-Based 
Imager, produce numerous substantially different spatially-varying 
speckle noise pattern elements (i.e. speckle noise pattern elements 
at different points) on each image detection element in the image 
detection array of the PLIIM-Based Imager. 


D 


Spatially (and temporally) average said spatially-varying speckle- 
noise pattern elements over the spatial area of each image 
detection element, thereby reducing the RMS power of speckle- 
pattern noise observed in said PLIM-Based Imager. 
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Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal identification (e.g. passport, drivers license, national 
identification card, etc.) in hand, as well as with articles of baggage to be carried on 
board by the passenger. 


Upon checking in with this station, the Passenger Identification (PID) Bar Code 
Symbol And Baggage Identification (BID) Bar Code Symbol Dispensing Subsystem 
issues (1) a passenger identification bracelet bearing (or otherwise encoded with) a 
PID bar code symbol, and (2) a corresponding PID bar code symbol for attachment 
to each package carried on the aircraft by the passenger. At the same time, this 
subsystem creates, for each passenger and set of baggage checked into the 
system at the check-in station, a passenger/baggage information record in the 
Passenger and Baggage Attribute RDBMS. 


The passenger identification (PID) bracelet (or identification badge) is affixed to the 
passenger s person at the passenger check-in station which is to be worn during the 
entire duration of the passenger" s scheduled flight. 


The PLIIM-Based Passenger Identification And Profiling Camera Subsystem at the 
passenger check-in automatically captures (i) a digital image of the passenger s 
face, head and upper body, (ii) a digital profile of his or her face and head (and 
possibly body) using the LDIP subsystem employed therein, and (iii) a digital image 
of the passenger s identification card(s). Other biometric information acquisition 
devices provided at the passenger check-in station can be used to aquire from each 
passenger checking-in, passenger attribute information (e.g. retinal pattern 
information, fingerprint pattern information, voice pattern information, facial pattern 
information, DNA pattern information) to assist in the reliable identification of the 


Each item of passenger attribute information acquired at the passenger check-in 
station is co-indexed with the corresponding passenger identification (PID) number, 
and stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 


FIG. 68D1 


Each BID bar coded article of baggage is conveyed through the tunnel-type 
package identification, dimensioning and tracking subsystem installed before the 
entry port of the X-radiation baggage scanning subsystem (or integrated there 
within), and is then conveyed through the X-radiation baggage scanning subsystem. 
As this scanning process occurs, each bar coded article of baggage is automatically 
identified, imaged, and dimensioned/ profiled by package identification, 
dimensioning and tracking subsystem and then imaged by x-radiation scanning 
subsystem. 
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Each item of baggage attribute information acquired at the baggage check-in station 
is co-indexed with the corresponding baggage identification (BID) number, and 
stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 


Each BID bar coded article of baggage is conveyed through a second tunnel-type 
package identification, dimensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated there within), and is conveyed through the EDS. 


At the EDS station, each bar coded article of baggage is automatically identified, 
imaged, and dimensioned/ profiled by package identification, dimensioning and 
tracking subsystem and then analyzed by EDS. 


Each item of baggage attribute information acquired at the EDS station is co- 
indexed with the corresponding baggage identification (BID) number, and stored in 
the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 


FIG. 68D2 


Conventional methods of detecting suspicious conditions revealed by x-ray images 
of baggage can be used (e.g. using an x-ray image monitor adjacent the x-ray 
scanning subsystem). 


Z 

Intelligent information processing algorithms can be used to automatically operate 
on each passenger and baggage attribute record stored in the Passenger and 
Baggage Attribute RDBMS. 


Passenger attribute information stored in remote intelligence RDBMS can be 
accessed and used with passenger and baggage attribute information in the 
Passenger and Baggage Attribute RDBMS in order to detect any suspicious 
conditions which may be given concern or alarm about either a particular passenger 
or article of baggage presenting concern or breach of security. 


Such post-check-in information processing operations can also be carried out on 
passenger and/ or baggage attribute information stored in the Passenger and 
Attribute RDBMS and/ or remote intelligence RDBMS on a wide area network 
(WAN) or local area network (LAN) with human assistance, if necessary, to 
determine if a breach of security appears to have occurred. 


If a breach is determined prior to flight-time, then the flight related to the suspect 
passenger and/ or baggage might be aborted with the use of security personnel 
signaled by subsystem. If a breach is detected after an aircraft has lifted off, then 
the flight crew and pilot can be informed by radio communication of the detected 
security concern. 


FIG. 68D3 
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Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal identification (e.g. passport, drivers license, national 
identification card, etc.) in hand, as well as with articles of baggage to be carried on 
board by the passenger. 


Upon checking in with this station, the Passenger Identification (PID) Bar Code 
Symbol And Baggage Identification {BID) Bar Code Symbol Dispensing Subsystem 
issues (1) a passenger identification bracelet bearing (or otherwise encoded with) a 
PID bar code symbol, and (2) a corresponding PID bar code symbol for attachment 
to each package carried on the aircraft by the passenger. At the same time, this 
subsystem creates, for each passenger and set of baggage checked into the 
system at the check-in station, a passenger/baggage information record in the 
Passenger and Baggage Attribute RDBMS. 


The passenger identification (PID) bracelet (or identification badge) is affixed to the 
passenger s person at the passenger check-in station which is to be worn during the 
entire duration of the passenger* s scheduled flight. 


The PLIIM-Based Passenger Identification And Profiling Camera Subsystem at the 
passenger check-in automatically captures (i) a digital image of the passenger s 
face, head and upper body, (ii) a digital profile of his or her face and head (and 
possibly body) using the LDIP subsystem employed therein, and (iii) a digital image 
of the passenger s identification card(s). Other biometric information acquisition 
devices provided at the passenger check-in station can be used to aquire from each 
passenger checking-in, passenger attribute information (e.g. retinal pattern 
information, fingerprint pattern information, voice pattern information, facial pattern 
information, DNA pattern information) to assist in the reliable identification of the 


Each item of passenger attribute information acquired at the passenger check-in 
station is co-indexed with the corresponding passenger identification (PID) number, 
and stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 


FIG. 69B1 


Each BID bar coded article of baggage is conveyed through the tunnel-type 
package identification, dimensioning and tracking subsystem installed before the 
entry port of the X-radiation baggage scanning subsystem (or integrated there 
within), and is then conveyed through the X-radiation baggage scanning subsystem. 
As this scanning process occurs, each bar coded article of baggage is automatically 
identified, imaged, and dimensioned/ profiled by package identification, 
dimensioning and tracking subsystem and then imaged by x-radiation scanning 
subsystem. 


Each item of baggage attribute information acquired at the baggage check-in station 
is co-indexed with the corresponding baggage identification (BID) number, and 
stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 


Each BID bar coded article of baggage is conveyed through a second tunnel-type 
package identification, dimensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated there within), and is conveyed through the EDS. 


At the EDS station, each bar coded article of baggage is automatically identified, 
imaged, and dimensioned/ profiled by package identification, dimensioning and 
tracking subsystem and then analyzed by EDS. 


Each item of baggage attribute information acquired at the EDS station is co- 
indexed with the corresponding baggage identification (BID) number, and stored in 
the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 


FIG. 69B2 


Conventional methods of detecting suspicious conditions revealed by x-ray images 
of baggage can be used (e.g. using an x-ray image monitor adjacent the x-ray 
scanning subsystem). 


Intelligent information processing algorithms can be used to automatically operate 
on each passenger and baggage attribute record stored in the Passenger and 
Baggage Attribute RDBMS. 


Passenger attribute information stored in remote intelligence RDBMS can be 
accessed and used with passenger and baggage attribute information in the 
Passenger and Baggage Attribute RDBMS in order to detect any suspicious 
conditions which may be given concern or alarm about either a particular passenger 
or article of baggage presenting concern or breach of security. 


Such post-check-in information processing operations can also be carried out on 
passenger and/ or baggage attribute information stored in the Passenger and 
Attribute RDBMS and/ or remote intelligence RDBMS on a wide area network 
(WAN) or local area network (LAN) with human assistance, if necessary, to 
determine if a breach of security appears to have occurred. 


If a breach is determined prior to flight-time, then the flight related to the suspect 
passenger and/ or baggage might be aborted with the use of security personnel 
signaled by subsystem. If a breach is detected after an aircraft has lifted off, then 
the flight crew and pilot can be informed by radio communication of the detected 
security concern. 
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Use an Internet-enabled client computer to establish a network 
connection (via network router) with an HTTP server in the tunnel- 
based LAN requiring remote monitoring, control and/or service. 


Use an Internet-enabled client computer to access an RMCS 
management console (GUI) from the HTTP server and display the 
same. 


1 

Use the RMCS managemen 
configuration parameters in the tu 
network configuration param< 
parameters and performance pf 
netw 

r 

t console to display network 
-inel-based LAN, and to use these 
3ters to monitor configuration 
irameters of each system in the 
rark. 


r 

Use the RMCS management console to monitor the configuration 
and other monitorable parameters of each subsystem in the system. 

\ 

t 


Use the RMCS management console to run a diagnostic program to 
trouble shoot any performance problems with the system. 


Using information collected by the diagnostic program and the 
RCMS management console, reconfigure selected parameters in 
the system and instruct any hardware repairs that may be required 
at the LAN location. 


FIG. 30D1 



Use the RMCS management console to rerun diagnostic programs 
on troubled systems and subsystems in the LAN after parameter 

reconfiguration and/or hardware repair at the LAN location, so as to 
test the performance of such systems and subsystems and the 
overall tunnel based LAN. 




Use the RMCS management console to monitor parameters of the 
system and subsystems in the tunnel based LAN, from time to time, 
to determine whether or not the system 
and/or network tunnel require servicing. 


r 


Use the RMCS management console to record all monitored 
parameter records and result of diagnostic programs in a customer 
service database for future reference, and access during 
subsequent remote service calls over the Internet. 


FIG. 30D2 



/' 



FIG. 31A 


For each package transported through tunnel system, the master unit (with 
package dimensioning subsystem and velocity detection subsystem) generates 
package height, width, length and velocity data (H, W, L, V) Q , referenced with 
respect to global coordinate reference system Rqiq^j ana " transmits such 
A package dimension data to each slave unit downstream, using the systems 
data communication network. 


/ 


Each slave unit receives the transmitted package height, width, and length 
data {H, W, L,V} G and converts this coordinate information into the slave unit's 
local coordinate reference system R Loca | f . {H, W, L, V}, 


The camera control computer in each slave unit uses the converted package 
height, width, length data {H, W, L}j and package velocity data to generate 
camera control signals for driving the camera subsystem in the slave unit to 
zoom and focus in on the transported package as it moves by the slave unit, 
while ensuring that captured images having substantially constant O.P.I. 
Resolution and 1:1 aspect ratio. 


FIG. 32A 


Each slave unit captures images acquired by its intelligently controlled camera 
subsystem, buffers the same, and processes the images to decode bar code 
symbol identifiers represented in said images, and/ or to perform optical 
character recognition (OCR) thereupon. 


The slave unit which decodes a bar code symbol in a processed image 
automatically transmits a package identification data element (containing 
symbol character data representative of the decoded barcode symbol) to the 
master unit (or other designated system control unit employing data element 
management functionalities) for package data element processing. 


Master unit time-stamps received package identification data element, places 
said data element in a data queue, and processes package identification data 
j elements and time-stamped package dimension data elements in said queue 
_/l to link each package identification data element with one said corresponding 
package dimension data element. 


FIG. 32B 
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Specify object detection and tracking capabilities of PLUM- based network , system, 
and/or subsystem. 


Specify object identification capabilities of PLIIM-based network , system, and/or 
subsystems. 


Specify object attribute acquisition capabilities of PLIIM-based network, system, and/ 
or subsystem. 


Determine the configuration of hardware components required to build the configured 
system or network. 


Determine the configuration of software components required to build the configured 
system or network. 


The system configuration manager program accesses the determined software 
components from its Software Library (e.g. maintained on an information server within 
the system engineering department), and compiles these software components with all 
other required software programs, to produce a complete System Software Package 
designed for execution upon a particular operating system supported upon the 
specified hardware configuration. 


The systems configuration manager program automatically generates an easy-to- 
follow set of Installation Instructions for the configured system or network, guiding the 
technician through an easy to follow installation and set-up procedures making sure all 
of the necessary system and subsystem hardware components are properly installed, 
and system and network parameters set up for proper system operation and remote 
servicing. 


Once the hardware components of the system have been property installed and 
configured, and the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may experience, and diagnose the same 

with or without remote service assistance made available through the remote 
monitoring, configuring, and servicing system of the present invention, illustrated in 
Figs. 30A through 30D2 
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LDIP REAL-TIME PACKAGE HEIGHT PROFILE AND 
EDGE DETECTION METHOD 


JTrsw Data Is Received Every 5 ms; Plus Time Stamp 


Convert Raw Data Into Range Profile R = f(int 
phase), Referenced With Respect To Polar 
Coordinate System Symbolically Embedded In LDIP 
Subsystem 


Use Geometric Transformations 

h(i) = R(i)sin(ang-90)And 

x(i) = R(i)tan(ang - 90) To Convert Range Profile 

R(i) into Height H(i) And Position x(i) Data 


Obtain Current Package Height By Finding Prevailing 
. Height Using Edge Detection Without Filtering (Fig. 
16) 


Find The Coordinates Of the Left And Right Edges 
Of Package (LPE, RPE) By Searching For The 
Ctosest Coordinates From The Edges Of The Belt 
(X a , X„) Toward The Center Thereof 


Analyze Intensity Data Values {R(nt)> And Determine 
The X Coordinate Position Range X^, , X M (In R 
Global) Where The Height Intensity Changes (i) 
Within The Spatial Bounds (X^, X Rpe ) And (ii) 
Beyond Predetermined Height Intensity Data 
Thresholds 


Create Time-Stamped Data Set{X LPE , h, X^V,,, nT} 
By Assembling Package Left Edge Coordinate (LPE), 
Current Package Height (h), Package Right Edge 
Coordinate (RPE), X Coordinate Subrange Where 
Height Values Exhibit Maximum Intensity Changes, 
Package Velocity (Vg), And Time Stamp (nT) 


LDIP Package Dimensioner 
With Integrated Velocity 
Detection 


Real-Time Package 
Height Profiling And 
Edge Detection 
Processing Module 
550 


Belt Velocity (V B ) 


FIG. 15 


LD1P REAL-TIME PACKAGE EDGE DETECTION 



Xa = Location Of Belt Left Edge; Xb = Location Of Belt Right Edge 
la = Belt Left Edge Pixel; lb = Belt Right Edge Pixel 
LPE = Left package Edge; RPE = Right Package Edge 
HQ = Pixel Height Array; XQ = Pixel Location Array 
win = Package detection Window 

FIG. 16 
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CAMERA CONTROL PROCESS CARRIED OUT WITHIN THE CAMERA 
CONTROL SUBSYSTEM OF EACH OBJECT IDENTIFICATION AND 
ATTRIBUTE ACQUISITION SYSTEM OF PRESENT INVENTION 

Start 


A' 


Camera Control Computer receives a time-stamped quintuple Data Set 

(i.e. coordinate of Left Package Edge, coordinate of Right Package 
Edge, height, velocity, and time stamp) from the LDIP Subsystem and 
stores the Data Set in a Package Data Buffer Structure having N=5 
/] columns and M rows; Camera Control Computer computes optical power 
(milliwatts) which each PLIA must produce (using method in Figs. 18C), 
and transmits the computed optical power to each PLIA and dependent 
system. 


Camera Control Computer analyzes height data in the Package Data 
Buffer and detects the occurrence of detecting discontinuities, and 
based on such detected height discontinuities, determines the 
corresponding coordinate position of the leading package edges by left- 
most and right-most coordinate values associated with the data set at 
this detected height discontinuity. 


Camera Control Computer determines the height of the 
package associated with the leading package edges 
determined at Block B above. 


FIG. 18A-1 


<5> 


Camera Control 

Computer 
transforms the 
position of left and 
right package edge 
(LPE, RPE) 
coordinates 
buffered in the 
deepest row of the 

Data Package 
Buffer at which the 
height value was 
determined at Block 
D to a Global 
Coordinate 
Reference System 

symbolically 
embedded in the 

conveyor belt 
structure beneath 
the LDIP 
Subsystem, as 
shown in Fig. 17. 


A. 


Camera Control 
Computer analyzes 
the height values (i.e. 
coordinates) computed 
over previous raw data 
set processing cycles 

and stored in the 
Package Data Buffer, 
and determines the 
"median" height of 
package, as well as 
the average "slope" of 
the package's laser 
scanned surface. 



FIG. 18A-2 
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2. 


Camera Control Computer detects the x-coordinates of the package 
boundaries based on the spatially-transformed coordinate values of 
the left and right package edges (LPE, RPE) buffered in the Package 
Data Buffer. 


Based on x-coordinates of the detected package boundaries (and 
optionally, the subrange of x-coordinates over which maximum range 
"intensity" data variations have been detected at Block F in Fig. 15) 
determined at Block O, the Camera Control Computer determines the 
corresponding pixel indices (i, j) in the Image Buffer which specify the 
image frame (i.e. region of interest) to be cropped from the image(s) 
to be subsequently captured by the IFD Subsystem. 


Camera Control Computer uses the Focus/Zoom Lookup Table in Fig. 
21 to determine the focus and zoom lens group positions based on 
the height of the package determined at Block D. 


® 


Camera Control Computer transmits Lens Group Moves Commands 
to the IFD Subsystem. 


IFD Subsystem uses the Lens Group Movement Commands to move 
the lens groups to their desired positions. 


Camera Control Computer checks resulting positions of moved 
lens groups. 


I 


y Camera Control Computer corrects lens group positions. 


No 



FIG. 18B-1 
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Camera Control Computer uses the computed values of median 
package height, belt speed and the Photo-Integration Time Lookup 
Table in Fig. 23 to determine the photo-integration time parameter 
which will ensure that "square" image pixels are produced in captured 
package images (i.e. pixels having a 1:1 ratio); Camera Control 
Computer also uses (i) computed belt speed/velocity, (ii) the pre- 
specified image resolution (dpi), and (iii) computed "slope" of laser 
scanned surface so as to compute the surface-slope compensated 
Line Rate of the IFD subsystem that helps ensure that captured linear 
images have substantially constant pixel resolution (dpi) independent 
of the angular arrangement of the package surface during surface 
profiling and imaging operations. 


Camera Control Computer generates digital control signals for the 
compute parameters-Photo-Integration Time Period and 
Compensated Line Rate- and thereafter transmits these digital control 
signals to the CCD image detection array in the IFD Subsystem. 


Camera Control Computer uses package time-stamp (nT) and 
package velocity (V ) to determine the "Start Time" of Image Frame 
Capture (STIC) 


Camera Control Computer uses (i) the Start Time of Image Capture 
(STIC) determined at Block Q, to generate a command for starting 
Image Frame Capture, and also uses (ii) the pixel indices (i,j) 
determined at Block P to generate commands for cropping the 
corresponding slice of the "region of interest" in the image being 
captured and buffered in the Image Buffer within the IFD Subsystem. 


Camera Control Computer transmits the command generated at Block 
R to the IFD Subsystem. 


FIG. 18B-2 


METHOD OF COMPUTING OPTICAL OUTPUT POWER FROM LASER 
DIODES IN A PLANAR LASER ILUMINATION ARRAY (PLIA) FOR 
CONTROLLING THE CONSTANT WHITE-LEVEL IN IMAGE PIXELS 
CAPTURED BY A PLIIM-BASED LINEAR IMAGER 


Compute the Line Rate of a Linear Image Detection Array (dots/ 
sec) based on computed Belt Velocity (inches/sec) and constant 
Image Resolution (dots/inch) desired, using equation: 

Line Rate = (Belt Velocity) x (Image Resolution) 


Compute the Photo-integration Time AT of the Linear Image 
Detection Array based on the computed Line Rate using the 
formula: 

Photo-integration Time Period = 1/Line Rate 



FIG. 18C1 
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Compute the Optical Power (milliwatts) of each PLIA based on the computed 
Photo-integration Time Period (AT) using the following formula: 

Optical Power of VLD (milliwatts) = constant 

Photo-integration Time Period AT 


FIG. 18C2 


METHOD OF COMPUTING COMPENSATED LINE RATE FOR CORRECTING 
VIEWING-ANGLE DISTORTION OCCURING IN IMAGES OF OBJECT 
SURFACES CAPTURED AS OBJECT SURFACES MOVE PAST A PLUM- 
BASED LINEAR IMAGER AT NON-ZERO SKEWED ANGLE 


Compute the Line Rate of Linear Image Detection Array (dots/sec) 
based on computed Belt Velocity (inches/sec) and constant Image 
Resolution (dots/inch) desired, using equation: 

Line Rate = (Belt Velocity) x (Image Resolution) 


Compute the Line Rate Compensation factor cosine (9 or 0), where 
0 and 0 is defined in Figs. 18E1 and 18E2, respectively, as the 
computed average scope of the packages surface (i.e laser 
scanned by the AM laser beams powered by the LDIP subsystem) 
and is computed at Block D in Fig. 18A. 


Compute the Compensated Line Rate for the IFD (i.e. camera) 
Subsystem using the equation: 


Compensated Line Rate = (Line Rate) x Cos(9)) 


FIG. 18D 
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METHOD OF AND APPARATUS FOR PERFORMING AUTOMATIC 
RECOGNITION OF GRAPHICAL INTELLIGENCE CONTAINED IN 2-D 
IMAGES CAPTURED FROM ARBITARY 3-D OBJECT SURFACES 


STEP 1: At the unitary PLIIM-based object imaging and profiling system, 
use the laser doppler imaging and profiling (LDIP) subsystem employed 
therein to (i) consecutively capture a series of linear 3-D surface profile 
maps on a targeted arbitrary (e.g. non-planar or planar) 3-D object 
surface bearing forms of graphical intelligence and (ii) measure the 
velocity of the arbitrary 3-D object surface, wherein the polar coordinates 
of each point in the captured linear 3-D surface profile map are specified 
in a local polar coordinate system R|_ D| p /po|ar , symbolically embedded 
within the LDIP subsystem. 

1 ~ 


STEP 2: At the unitary PLIIM-based object imaging and profiling system, 
use coordinate transforms to automatically convert the polar coordinates 
of each point p(a, R) in the captured linear 3-D surface profile map into 
x,y, z Cartesian coordinates specified as p(x,y,z) in a local Cartesian 
coordinate system R LD |p/c a rtesiari' s y mbolica ily embedded within the LDIP 
subsystem. 

l 


STEP 3: At the unitary PLIIM-based object imaging and profiling system, 
use the PLIIM-based imager employed therein to consecutively capture 
high-resolution linear 2-D images of the arbitrary 3-D object surface 
bearing forms of graphical intelligence (e.g. symbol character strings), 
wherein (i) the x\ / coordinates of each pixel in each said captured high- 
resolution linear 2-D image is specified in local Cartesian coordinate 
system Rp L)|M/Cartesjan symbolically embedded within the PLIIM-based 
imager, and (ii) the intensity value of the pixel l(x',y') is associated with the 
x\ y' Cartesian coordinates of the image detection element in the linear 
image detection array at which the pixel is detected, and (iii) wherein also 
the planar laser illumination beam (PLIB) of the PLIIM-based imager is 
spaced from the amplitude modulated (AM) laser scanning beam of the 
LDIP subsystem is about D centimeters. 


FIG. 23C1 
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STEP 4: At the unitary PLHM-based object imaging and profiling system, 
capture and buffer the camera (IFD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the corresponding 
photo-integration time period AT K , by the PLHM-based imager. 


STEP 5: At the end of each photo-integration time period AT K , use the 
unitary PLHM-based object imaging and profiling system to transmit the 
following information elements to the Image Processing Computer for 
data storage and subsequent information processing: 

(1) the converted coordinates x, y, z, of each point in the linear 3-D 
surface profile map of the arbitrary 3-D object surface captured during 
photo-integration time period AT K ; 

(2) the measured velocity(ies) of the arbitrary 3-D object surface 
during photo-integration time period AT K ; 

(3) the x*, y' coordinates and intensity value l(x',y') of each pixel in 
each high- resolution linear 2-D image captured during photo-integration 
time period DTk and specified in the local Cartesian coordinate system 

R PLIIM/Cartesian ; and m , , A 

(4) the captured camera (IFD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the photo- 
integration time period AT K 


STEP 6: At the Image Processing Computer, receive the data elements 
transmitted from the PLIIM-based profiling and imaging system durin Step 
5, buffer data elements (1) and (2) in a first FIFO buffer memory structure, 
and data elements (3) and (4) in a second FIFO buffer memory structure. 


FIG. 23C2 


STEP 7: At the Image Processing Computer, use the x,y, z coordinates 
associated with a consecutively captured series of linear 3-D surface 
profile maps (i.e. stored in first FIFO memory storage structure)in order to 
construct a 3-D polygon-mesh surface representation of said arbitrary 3-D ^-G 
object surface, represented by S LDIP (x,y,z) and having (i) vertices 
specified by x,y, z in local coordinate reference system R PL |iM/Cartesian' 
and (ii) planar polygon surface patches s (x,y,z) and being defined by a 
set of said vertices. 


X 


STEP 8: At the Image Processing Computer, convert the x\y',z' 
coordinates of each vertex in the 3-D polygon-mesh surface 
representation into the local Cartesian coordinate reference system 
R PLliM/Cartesian symbolically embedded within the PLIIM-based imager. 


STEP 9: At the Image Processing Computer, specify the x',y\ z' 
coordinates of each i-th planar polygon surface patch s(x,y,z) represented 
in the local Cartesian coordinate reference system R PL ||M/cartesiair s0 as 
to produce a set of corresponding polygon surface patch {s j {x',y , > z')} 

represented in system RpLi IM /carteslan 

I 


STEP 10: At the Image Processing Computer, for a selected linear high- 
resolution 2-D image captured at photo-integration time period AT K , and 
spatially corresponding to one of the linear 3-D surface profile maps 
employed at Step 7, use the camera (IFD) parameters used and recorded 
{i.e. captured) during the corresponding photo-integration time period in 
order to construct a 3-D vector-based "pixel ray" model specifying the 
optical formation of each pixel in the linear 2-D image, wherein a pixel ray 
reflected off a point on the arbitrary 3-D object surface is focused through 
the camera's image formation optics (i.e. configured by the camera 
parameters) and is detected at the pixel's detection element in the linear 
image detection array of the IFD (camera) subsystem. 


FIG. 23C3 


STEP 1 1 : At the Image Processing Computer, for each laser beam ray 
(producing one of the pixels in said selected linear 2-D image), (i) 
determine which polygon surface patch Sj(x, y, z) the pixel ray intersects, 
(ii) compute the x,y, z coordinates of the point of intersection (POI) 
between the pixel ray and the polygon surface patch represented in 
Cartesian coordinate reference system RpLuiwcartesian' and des '9nate 
the computed set of points of intersection as {Pj(x,y,z)>. 


STEP 12: At the Image Processing Computer, for each laser beam ray 
passing through a determined polygon surface patch s(x',y\ z') at a 
computed point of intersection p.(x, y, z), assign the intensity value l(x',y') 
of the pixel ray to the x', y\ z* coordinates of the point of intersection, 
thereby producing a linear high-resolution 3-D image comprising a 2-D 
array of pixels, each said pixel pixel having as its attributes (i) an Intensity 
value Kx'.y'.z') and (ii) coordinates x', y', z' specified in the local Cartesian 
coordinate reference system Rp LnM/C artesian- 


STEP 13: Put the computed linear high-resolution 3-D image in a third 
FIFO memory storage structure in the image processing computer. 


STEP 14: Repeat Steps 1-6 to update the first and second FIFO data 
queues maintained in the image processing computer, and Steps 7-13 to 
update the consecutively computed linear high-resolution 3-D image 
stored in the third FIFO memory storage structure. 


STEP 15: Assemble in an image buffer in the image processing 
computer, a set of consecutively computed linear high-resolution 3-D 
images retrieved from the third FIFO data storage device so as to 
construct an "area-type" high-resolution 3-D image of said arbitrary 3-D 
object surface. 


FIG. 23C4 


STEP 16: At the Image Processing Computer, map the intensity value 
l(x\ y\ z') of each pixel in the computed area-type 3-D image onto the 
x'.y',^ coordinates of the points on a uniformly-spaced apart "grid" 
positioned perpendicular to the optical axis of the camera subsystem (i.e. 
to model the 2-D planar substrate on which the forms of graphical 
intelligence was originally rendered), wherein said mapping process 
involves using an intensity weighing function based on the x\ y\ z' 
coordinate values of each pixel in the area-type high-resolution 3-D 
image, thereby producing an area-type high-resolution 2-D image of the 
2-D planar substrate surface bearing said forms of graphical intelligence 
(e.g. symbol character strings). 

I — 

STEP 17: At the Image Processing Computer, use said OCR algorithm to 
perform automated recognition of graphical intelligence contained in said 
area-type high-resolution 2-D image of said 2-D planar substrate surface 
so as to recognize said graphical intelligence and generate symbolic 
knowledge structures representative thereof. 

I 

STEP 18: Repeat Steps 1-17 as often as required to recognize changes 
in graphical intelligence on the arbitrary moving 3-D object surface. 


FIG. 23C5 
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Specify object detection and tracking capabilities of PLilM-based network, 
. A system, and/or subsystem. 

I 


Specify object identification capabilities of PLIIM-based network , system, and/ 
/ or subsystems. 


Specify object attribute acquisition capabilities of PLIIM-based network, 
system, and/or subsystem. 


D 


Determine the configuration of hardware components required to buiid the 
/ configured system or network. 


Determine the configuration of software components required to build the 
configured system or network. 


F 


The system configuration manager program accesses the determined software 
components from its Software Library (e.g. maintained on an information server 
within the system engineering department), and compiles these software 
A\ components with all other required software programs, to produce a complete 
System Software Package designed for execution upon a particular operating 
system supported upon the specified hardware configuration. 


The systems configuration manager program automatically generates an easy 
to follow set of Installation Instructions for the configured system or network, 

guiding the technician through an easy to follow installation and set-up 
procedure making sure all of the necessary system and subsystem hardware 
components are properly installed, and the system and network parameters are 
set up for proper system operation and remote servicing. 


H 


Once the hardware components of the system have been properly installed and 
configured, the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may experience, and diagnose the 
same with or without remote service assistance made available through the 
remote monitoring, configuring, and servicing system of the present invention, 
illustrated in Figs. 30A through 30D2. 


FIG. 25C 
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